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We present a differential geometric viewpoint of the quantum MaxEnt estimate of a density 
operator when only incomplete knowledge encoded in the expectation values of a set of quantum 
(«~^ ' observables is available. Finally, the additional possibility of considering some prior bias towards a 

I certain density operator (the prior) is taken into account and the unsolved issues with its quantum 

relative entropic inference criterion are pointed out. 
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; I. INTRODUCTION 

It is well established that geometry plays an important role in characterizing and understanding both classical 
Oh- and quantum physics. After all, it has been an old dream to reduce the fundamental laws of physics to geometry 
(-H I since Einstein's formulation of general relativity. In particular, it is a remarkable achievement that all the building 
blocks of quantum field theory can be formulated in terms of geometric concepts such as vector bundles, connections, 
curvatures, covariant derivatives and spinors [Ij. 

It is well known that all practical problems in science are characterized by incompletely specified situations where 
we can only provide an inference (plausible conjecture) [5]: given incomplete information about reality, we choose 
probability distributions that represent the state of (incomplete) knowledge of the system being considered. The 
J> ■ incompleteness of information leads to the non-uniqueness of the reconstructibility of the state of the classical system, 
C^l ' that is, more than one situation is compatible with what is known. However, some situations are more likely to occur 
than others. This leads to a probabilistic description of dynamical systems in the presence of partial knowledge. 
Furthermore, it is also the case that geometry can be of some use for the study of inference. In particular, a number 
I of investigations have shown that a useful approach to the study of statistical inference is to regard a parametric 
' statistical model as a differentiable manifold equipped with a metric structure Of course, as pointed out by 
Shilling , like any other professional tool, " geometry should be used with intelligence and care^^ . 
' I In recent years, we have employed information geometry 5] (Riemannian geometry applied to probability theory) 

. . , and inductive inference (the Maximum relative Entropy method (MrE) [6] of which Jaynes' MaxEnt |i7,] is a special 
K>" ■ case) to study the complexity of informational geodesic flows on curved statistical manifolds (statistical models) 
underlying the probabilistic description of physical systems in the presence of incomplete information [8,]. Most of 
this work has dealt with ordinary probability distributions. However, what happens if the state of the system is 
' represented by a quantum density operator? Are Riemannian geometric techniques of some utility in such cases? Is 
there an inference method useful to assign a density operator given a specific set of expectation values of quantum 
observables? Is there a quantum entropic inference method that can be used to update density operators when some 
prior bias towards a certain density operator (the prior) is assumed? Such inference problems occur in situations in 
which information is gained in two steps. In the first step, experiments are carried out to determine a prior density 
operator p^. In the second step, more knowledge is gained about the expectation values of certain quantum observables 
{Afc}. How should one determine the density operator p which is best suited to make further predictions, accounting 
fully for both types of information? In this work we provide a few answers to such questions and emphasize some 
conceptual and computational problems that may emerge. 



II. INFERENCE AND DENSITY OPERATORS 



Jaynes's MaxEnt method can be extended to the quantum density-matrix formalism in a straightforward manner 
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Assume we are given the expectation values of the quantum operators Ai,..., Am- Stated otherwise, the quantities 
Aj with j — 1,..., m are the quantum observables which represent the slow variables of the theory [Toj . that is, those 
whose expectation values can be measured at any given time. For the sake of reasoning, assume that the information 
constraints are given by. 



(Aj) '^^^tr{pAj), with j 



1, 



m. 



(1) 



We point out that if the constraints ([T]) involve only commuting observables Aj , the quantum method can be reduced 
to the classical one. In this case, there exists a basis in the Hilbert space in which all Aj are represented by diagonal 
matrices. In this basis, p should also be diagonal and diagonal elements are ordinary probabilities. Indeed, it can 
be shown that Jaynes' MaxEnt method also works for non-commuting observables In this case, however, the 

off-diagonal elements of p must be considered and this has no equivalent in standard probability theory. The values 
Aj are averages obtained in a large number of experiments performed on an ensemble of identically prepared systems. 
The necessity of an ensemble is obvious if we consider a situation in which the state to be characterized is specified 
by giving the expectation values of non-commuting observables. This requires that measurements associated with 
each (non-commuting) observable is performed on different samples, belonging to separate sub-ensembles of the full 
ensemble whose state is described by p. Using the Lagrange multipliers technique, it can be shown that the density 
matrix p which represents the most unbiased picture of the state of the system on the basis of this much information 
is the one maximizing the von Neumann entropy S{p), 



S{p) =^-tr(plogp). 



(2) 



subject to the information constraints in ([1]) and to the normalization condition tT[p) = 1 . As a side remark, we point 
out that S{p) is invariant under unitary transformations. This is an important property of the von Neumann entropy 
and is very desirable since we require that our macroscopic predictions should remain unchanged if the observables 
are unitarily transformed. As in the classical case, the maximization process is accomplished by finding the density 
matrix p which solves the variational problem. 



~tr (plogp) - Ao {tip - 1) - XI -^fc (/^^fc) ~ ^k) 



k=l 



0, 



(3) 



where 6 = Sp is the variational operator. After some simple algebra, it follows that Eq. ^ reads. 



logp + Aol + ^AfeAfc 



fc=i 



logp + Aol + ^AfcAi 



fe=i 



(4) 



where 1 is the identity operator. We point out that one of the main technical difficulties that occur in the quantum 
setting is that the chain rule for derivatives does not hold: p and Sp do not necessarily commute [10]. That said, the 
solution of the variational problem in (jU is achieved by imposing the condition. 



logp + Aol + ^AfcAfc = 0, 



fc=i 



p — exp 



k=l 



(5) 



(6) 



The Lagrange multipliers Aq in ([6]) is determined by the normalization condition tr(p) = 1. As a matter of fact, 
noticing that exp (— AqI) equals exp (— Aq) 1, the condition tr(p) — 1 yields 



1 = tr 



exp -AqI - X XkAk 



exp (— Ao) tr 



exp 



k=l 



^AfeAfe 



(7) 



fc=i 



that is, 



Ao = logZ(Ai,..., A™) , 



(8) 
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where Z is the so-called partition function defined as, 

Z = Z (Ai,..., Am) 

1, 



dof 



tr 



exp 



k=l 



(9) 



The remaining Lagrange multipliers Xk with k 
particular one finds, 



{A,) ='tr (pA,) =exp(-Ao)tr 



Aj exp - ^ XkA 



m are determined by the information constraints ([T]). In 

1 r dziXi,..., 



k=l 



Z (Al,..., Am) 



9A, 



that is, 



91ogZ(Ai,..., Am) 
dX, 



(10) 



(11) 



Thus, the Lagrange multipliers Xj with j = 1, 



are implicitly defined in Eq. ()1I|) . Indeed, the multipliers Aj may 



also be expressed in an explicit manner. Observing that 5max = 5* (p) with p in (jS]) is given by, 

(Al,..., A„i) Ao + XiAi + .... + XraAjn, 

we conclude that, 

95,nax {Al,..., A 

m I 



A, 



OA, 



(12) 



(13) 



In general, it may be highly non trivial to solve explicitly the system of equations for the Lagrange multipliers Xj in 
P^ . Finally, substituting and ([T^ into ([5]), we obtain the "quantum MaxEnt estimate", 



p = p {Al,..., A„\Ai,..., Am) = 



exp 


™ as_(A,....,A„) 1 
fe 1 




tr 


exp 







(14) 



We point out that the quantum MaxEnt estimate is always a physical state thanks to the canonical form of the 
density operator in (IT4|) . We recall that although Jaynes' MaxEnt was originally developed for assigning probability 
distributions [7,] , it can also be regarded as a special case of the MrE method when updating probability distributions 
from a uniform prior using the Gibbs-Shannon entropy [H]- In the quantum framework, Jaynes' MaxEnt is employed 
to assign density operators via maximization of the von Neumann entropy However, although at the moment 
there is no universal quantum MrE method for updating density operators, the quantum MaxEnt formalism may 
be viewed as a limiting case of a possible updating criterion from uniform prior density operators where inference is 
carried out by means of the logarithmic quantum relative entropy. 



dcf 



S{p\\Pq) = -tr[/9(logp-logpo)]. 



(15) 



When the prior p^ is uniform and proportional to the identity operator 1 acting on an n-dimensional Hilbert space, 
S (pIIpo) reads 



S{p\\Pn) ^S{p) -logn. 



(16) 



Thus, maximizing ^ is equivalent to maximizing (ITBl) . We remark that the use of ([T51) as a suitable entropic tool for 
quantum inferences (updating density matrices from arbitrary priors) appears in [l2| as well. For forthcoming utility, 
we assume a bias towards a uniform prior density operator Pq. Then, the maximization of the quantum logarithmic 
relative entropy (IT6l) subject to a fixed information constraint A = (A) leads to the MaxEnt estimate, 



— A 4 _ A 4 
e ^ PqC 2 



tr (e^^^Po) tr (e^'^^pp) 



(17) 



The Jaynes MaxEnt method has been successfully applied to partial (incomplete) reconstruction of density operators 
of quantum systems from the available measured mean values of the system's observables (single spin-i, two correlated 
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spins-i, Greenberger-Horne-Zeilinger states, vibrational states of neutral atoms, etc.) [l^l- Unfortunately, Jaynes' 
MaxEnt quantum formalism is not without criticisms in the scientific community. Indeed, it has been claimed that 
quantum state estimates derived via the principle of MaxEnt are fundamentally different from those obtained via the 
quantum Bayes rule This seems understandable and it is somehow expected. By definition, "a probability is 

an abstract notion that represents the degree of plausibility of a proposition, subject to information regarding that 
proposition" [l^. Thus if one has different information one should come to different probabilities. However, just as 
Maximum relative Entropy successfully showed that one can use a universal method (MrE) for any type of classical 
information, it may be possible that a quantum version of MrE will do the same for the quantum case. 



III. GEOMETRY AND DENSITY OPERATORS 

In 1985, Campbell showed that geometry can be introduced into probability calculus as follows [l^: for a fixed 
probability distribution, define the inner product of two random variables to be the expectation of the product of 
these variables. Differential geometry emerges when we consider varying the probability distribution, either directly 
or through changing parameters on which the distribution depends. Within such a geometric framework, the sets 
of probability distributions are viewed as differentiable manifolds, the random variables appear as vectors and the 
expectation values of random variables are replaced with inner products in tangent spaces to such manifolds of 
probabilities. In particular, the MaxEnt estimate of a probability distribution given a prior and the information 
constraints is found by following an integral curve through the prior which is orthogonal (in the Fisher metric on the 
simplex) to the hyperplane defined by the information constraint equation until the constraint is satisfied. In 1995, 
Braunstein and Caves extended Campbell's ideas to the quantum framework [iTj . Here, following their analysis, we 
provide a differential geometric viewpoint of the (generalized) quantum MaxEnt estimate (jl7p . 

Consider the quantum analogue A4p of the probability simplex, the space of density operators p written as vectors 
in C (H), the linear space of all linear operators on a n-dimensional Hilbert space 



""^^ {peC{n):p f^'^^i^ p = tr (p) = 1, p > 



(18) 



The space J^p is an {n^ — l) -dimensional real manifold with complicated boundary. An arbitrary linear operator 
vector V QTiT-L can be decomposed in terms of an operator vector basis Cij =^ \i) {j\ with i, j = 1,..., n as follows. 



V = 



I. 3 = 1 



i\V\j 



i, J = l 



The tangent space at p is an (n? — l) -dimensional real vector space of traceless Hermitian operators T, 

n 

f^Y. ^''e^'j' ^^^^^ =0- 

h 3 = 1 



(19) 



(20) 



The action of 1-forms F expanded in terms of the dual basis uj-'^ \i) {j\ 



on density operators p is defined as follows 

f{p)^(f, p 



z, j, /, k—1 



2, J, /, A:— 1 



i, 3 = 1 



(21) 



(22) 



Therefore, an Hermitian 1-form _F = is an ordinary quantum observable with (F,p) = (F). A metric structure 



gp (•, •) on the manifold Mp can be introduced by defining the metric's action on a pair of 1-forms A and B as follows, 



9p 



p (i, b) 



AB + BA 



tr 



Y ab + bA\ J 






= tr 



(pB + Bp 



i. Up (s) 



(23) 
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where TZa {b^ is the raising operator mapping 1-forms (lower covariant components) to vectors (upper contravariant 
components), 



7^s 



(24) 

Such a metric is formulated in terms of statistical correlations of quantum observables. Using the lowering operator 
(^A^ mapping vectors to 1-forms, 

Cp (a) ^ 1 [a) , (25) 
we can also define the action of the metric tensor (•, •) on a pair of vectors A and B, 

gp (1, B) l^Lp (I) , S) = tr \bII~, (l) ] . (26) 

The quantum line element ds^, 

= gp (dp, dp) , (27) 

with dp given by, 

n n 

= {p"'-p')hi^\l){m\, (28) 

j — 1 m, l — l 

and with e'^^^^ an infinitesimal unitary transformation on the orthonormal basis that diagonalizes reads 

^ ^ ^ (rfpjr 2,,. if -P^y \h,,\^ . (29) 



Notice that the quantum line element ([29]) is identical to the distinguishability metric for density operators obtained by 
Braunstein and Caves by optimizing over all generalized quantum measurements for distinguishing among neighboring 
quantum states [18]. 

The notion of quantum "transport" can also be introduced in this geometric framework. Consider a surface defined 
by the relation ^^^^ — 0> where =^ — (^A, jjj 1 is the zero mean observable and 1 is the unit 1-forni operator. 

Any tangent vector t that lies on the surface (^^^^ — satisfies (^AA, tj = 0. This implies that a vector field 

TZp (^^^) associated with the observable AA is orthogonal to the surface ^^^^ — since, 

gp (Tip (aa) , i) = (aA, i) = 0. (30) 



The most efficient way to construct a path that goes from the state Pq to another state that has a different expectation 
value for A is by consistently moving in the direction orthogonal to the surfaces (^AA^ ~ 0. This navigation is 

accomplished by selecting a parametrized path p = p{X) with p{X = 0) = Pq along the vector field TZp (^Aij such 
that, 

^+K,(i-(i)i).0, ,31, 

^ e 2^p e 2^ 

P(A) = J (32) 

tr [e-^^poj 

The path (j32p is reminiscent of a quantum exponential model of symmetric type . In conclusion, from a differential 
geometric point of view, the (generalized) MaxEnt estimate (fTT]) can be regarded as a quantum trajectory ([32l) that 
passes orthogonally through the family of surfaces of constant expectation value corresponding to some observable 
(1-form). 



that is. 
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IV. FINAL REMARKS 

In this article, we presented a differential geometric viewpoint of the quantum MaxEnt estimate of a density operator 
when only incomplete knowledge encoded in the expectation values of a set of quantum observables is available. The 
additional possibility of considering some prior bias towards a certain density operator (the prior) was taken into 
account by using MrE and the unsolved issues with its relative entropic inference criterion were pointed out. 

Although we limited our analysis to uniform priors and commutative observables (non-commutative extensions of 
(|17|1 are under investigation), we must point out that care is needed in handling the non-commutativity of quantum 
observables. Furthermore, Jaynes' quantum MaxEnt method deals solely with assigning density operators. In the 
most optimistic scenario, we could use this method also in the presence of uniform priors. However, in actual scenarios, 
the prior is not uniform and a quantum entropic updating method is required. Unfortunately, there is a lack of a 
direct axiomatic justification (consistency requirements) for the use of the logarithmic quantum relative entropy 
maximization criterion for entropic inferences (llj . We also stress that although the Maximum relative Entropy 
method for updating probabilities includes both Jaynes' MaxEnt and Bayes' rule [6|, a similar result in the quantum 
framework is still missing. Finally, Bayesian quantum inferences for determining quantum states depend on the prior 
as well as measurement data, even in the limit of an infinite number of measurements [20| . Furthermore, we are also 
aware that there has been some controversy over the naturalness of relative entropy as a tool for quantum statistical 
inference j2l|. As a matter of fact, when the quantum- mechanical concept of relative entropy is discussed from an 
information-theoretic point of view, it can be shown that not all definitions found in the literature are equally suitable 
for the purpose of statistical inference by entropy maximization . 

In view of all the above-mentioned considerations, we believe that an axiomatic formulation of a "universal" 
quantum entropic updating methodology embracing the quantum Bayes' rule as a special case should to be 
developed. However, just as the Maximum relative Entropy method did this for the classical case, it is our hope that 
a quantum version (with non-uniform priors) can be constructed. 
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